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Abstract 



> 

As a consequence of the dependence experienced in loan portfolios, the standard 

m 

appropriate for validating probabilities of default (PDs) . The model underlying the 
' new rules for minimum capital requirements (Basle II) is taken as a point of de- 



binomial test which is based on the assumption of independence does not appear 



parture for deriving two parametric test procedures that incorporate dependence 



effects. The first one makes use of the so-called granularity adjustment approach 



while the the second one is based on moment matching. 



s 

The aim with this note is to present an approximate procedure for one-observation-based 
inference on the adequacy of probability of default (PD) forecasts. The PD forecast for a 
homogeneous portfolio of loans has to be compared to the realized default rate one year 
later. In case of independent default events, the natural procedure for this comparison 
would be the standard binomial test. However, the well-known fact that default events 
are correlated makes the binomial test appear unreliable. 

Our approach here is to model the dependent default events in a Basle II-like style and to 
arrive this way at a means to compute critical values which respect correlations. However, 
in the Basle II-model the distribution of default rates cannot be calculated with elementary 
arithmetic procedures as they are available for instance in MSExcel. Therefore we suggest 
two approximation schemes which seem to work with reasonable precision. 
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This note is organized as follows. In Section 1, we describe the general design of a traffic 
lights procedure for PD validation. Section 2 then specifies the stochastic model under- 
lying the granularity adjustment and moment matching approximation procedures to be 
introduced in Sections 3 and 4 respectively. We conclude in Section 5 with a numerical 
illustration of the approaches. 

1 Setting the colors 

We fix two confidence levels a\ ow and «hi g h, e.g. ai ow = 95% and ahigh — 99.9%. Assume 
that the forecast for the default rate is p. Under this assumption, we have to find critical 
values ciow and Chi g h such that the probabilities that the realized number of defaults 
exceeds c\ ow and Chigh will equal 100% — o;i ow and 100% — cthigh respectively. 

The traffic light for the adequacy of the PD forecast will be set green, if the realized 
number of defaults is less than c\ ow . In this case there is no obvious contradiction between 
forecast and realized default rate. 

The traffic light will be set yellow, if the realized number of defaults is equal to or greater 
than ciow but less than Chigh- The yellow light indicates that the realized default rate is 
not compatible with the PD forecast. However, the difference of realized rate and forecast 
is still in the range of usual statistical fluctuations. As a consequence, the responsibility 
for the deviation of the forecast cannot without doubt assigned to the portfolio manager. 

The traffic light will be set red, if the realized number of defaults is equal to or greater 
than Chigh- In this case, the difference of forecast and realized default rate is so large that 
any disbelief in a wrong forecast would be unreasonable. 



The first step towards determining the critical values ci ow and Chigh is to fix a stochastic 
model that will enable us to carry out the necessary numerical calculations. We take the 
Vasicek one factor-model which underlies also the Basle II risk weight functions. 

If n denotes the number of loans in the portfolio under consideration and D n is the realized 
number of defaults in the observed period of time, we write D n as 



2 Specifying the stochastic model 



n 





i=l 



2 



In (1), 1e is the indicator function assuming the value 1 on the event E and the value 
on the complement of E. X and £i, . . . , £ n are independent standard normal random 
variables. The threshold t has to be chosen in such a way that 

E[D n ] = np. (2a) 

This will be achieved by setting 

t = (2b) 

with $ denoting the standard normal distribution function. The choice of the parameter 
p (sometimes called asset correlation) is not so obvious. It should not be chosen higher 
than 0.24 which is the highest correlation occurring in the Basle II rules. One way to 
handle this question would be to leave the choice of a value for p to the discretion of the 
national supervisors. For instance, p = 0.05 appears to be appropriate for Germany. 



3 The granularity adjustment approach 

In order to make work the traffic lights approach we have to find methods for calculating 
the critical values which have been introduced in Section 1. For instance, the critical value 
Ciow is characterized by 

c iow = min{£; : P[D n > k] < 1 - ai ow }- (3a) 

(3a) is equivalent to 

ciow = g(«iow, D n ) + 1, (3b) 
where q(a, D n ) denotes the usual a-quantile of D n , i.e. 

q(a,D n ) = min{:r : P[D n < x] > a}. (3c) 

Analogously, we have 

Chigh = q((Xhi g h,D n ) + 1. (3d) 

Write 

R n = D n /n (4a) 

for the default rate corresponding to the number of defaults D n . For computational rea- 
sons, it is often appropriate to consider R n instead of D n . But, of course, the quantiles of 
R n and D n are related by 

nq(a,R n ) = q(a,D n ). (4b) 

Since the distribution of D n cannot be calculated with elementary methods, Gordy (2002) 
suggested the granularity adjustment approach for approximating the quantiles q(a,R n ). 
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This approximation is based on a second order Taylor expansion of q(a, R n ) in the fol- 
lowing sense 

q(a, R n ) = q(a, R + h (R n - R)) (5a) 



h=l 



d 



q(a, R) + t^ q(a, R + h(R n - R)) + - q(a, R + h(R n - R)) 
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2 



dh 

The random variable R in (5a) can be chosen as 



h=0 



,t — ,/pX, 

R = lim R n = $ ZL- . (5b) 

Vl - p 



n^oo 



The quantile q(a, R) turns out to be 

q{a,R) = y== ), (5c) 

and, as a consequence, can easily be calculated. Unfortunately, when defining R with 
(5b), the partial derivatives in (5a) may not exist because the distribution of D n is purely 
discrete. However, Martin and Wilde (2002) noted that although (5a) was derived for 
smooth distributions its application may yield sensible results even in semi-smooth situ- 
ations. Using the formulas for the derivatives by Martin and Wilde (2002) one arrives at 
(cf. Tasche, 2003) 

q(a,D n )^nq(a,R) + U2q{a,R)-l (6) 



q(a,R)(l-q(a,R)) ( - a, X) - t _ [T=j _ 
0(v^(W£M) ^ V /T^7 " V P q[ } 

where <f>(x) = (2 7r) _1 e~ x2 / 2 denotes the standard normal density. 

For given forecasted PD p and asset correlation p, by means of (3b), (3d), and (6) the 
critical values for the traffic lights approach respecting correlation can be calculated. 



4 Fitting the default rate distribution with moment 
matching 

A further approach to determine the critical values defined by (3b) and (3d) can be based 
on approximating the distribution of R n as given by (1) and (4a) with a Beta-distribution. 
When proceeding this way, the parameters of the Beta-distribution are determined by 
matching the expectation and the variance of R n (cf. Overbeck and Wagner, 2000). 



4 



Recall that the density of a B(a, b) -distributed random variable Z is defined by 

P(a, b; x) = ^rtfi) x- 1 (1 - x) 6 - 1 , < x < 1, (7a) 

where V denotes the Gamma-function expanding the factorial function to the positive 
reals, and that the expectation and the variance respectively of Z are given by 

r n a b , 

L J (a + b) 2 (a + b + 1) 

Equating the right-hand sides of (7b) and (7c) with E[R n ] and var[i? n ] respectively leads 
to 

a= ggj 
var[i?„ 

and 



(Efi^Kl-Ef^D-varf^]) (8a) 



b = 1 E[R ] ^ (i _ E[i?J) _ var[ ^^ (gb) 
var [rt n \ 

It is not hard to show that 

E[R n ] = P (9a) 

and 

Tl — 1 T) 

var[i? n ] = $ 2 (t, t, p) + - - p 2 , (9b) 

n n 

with t defined by (2b) and $2 denoting the bivariate standard normal distribution func- 
tion. Since common tools like MSExcel have not got implemented algorithms for the 
calculation of $2, the approximation 

* 2 {t,t,p) « $(t) 2 + ^(p+l/2p 2 t 2 ) (10) 

can be used in (9b). (10) is based on a second order Taylor expansion of $2(^5 t,p) with 
respect to p (cf. Tong, 1990) and yields a fairly good approximation for moderate values 
of p and a. As will be shown in Section 5, the quality of approximation decreases for 
p > 0.2 and values of a close to one. 

By means of (10), (9a), and (9b), the quantile q(a,D n ) can be calculated approximately 
via 

q(a,D n ) w nq(a,Z), (11) 

where Z is a Beta-distributed random variable and the parameters a and b of its distri- 
butions are given by (8a) and (8b) respectively. 
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5 Numerical examples 



For the purpose of illustration of the previous sections, we calculated the lower and 
higher critical values of the traffic lights for various portfolio sizes n and two different 
asset correlation values. Table 1 shows the 95%-critical values for a test of PD < 0.01 
in case of low (p = 0.05) and high (p = 0.2) asset correlation. We compare the results 
obtained with the classical binomial test, the granularity adjustment of Section 3, and 
the moment matching of Section 4. Since the binomial test relies on the assumption of 



n 


50 


250 


1000 


50 


250 


1000 


Approach: 


p = 0.05 


p = 0.2 


Binomial 


2 


5 


15 


2 


5 


15 


Granularity adjustment 


3 


7 


24 


3 


11 


39 


Moment matching 


4 


8 


25 


4 


12 


42 



Table 1: 95%-critical values for PD tests of hypothesis p < 0.01. 



independent default events, there is no difference when switching the correlation regime 
from low to high. For the other approaches, this picture changes dramatically. Respecting 
the correlation makes grow a lot the critical values, with more than doubling in case of high 
correlation. At this quite moderate confidence level of 95%, the results of the granularity 
adjustment and the moment matching approach do not differ much, although differences 
appear to become larger with an increasing portfolio size and higher correlation. 

As the numbers in Table 2 show, the effects described for the case of a moderate confidence 
level become much more pronounced when we consider a very high confidence level like 
99.9%. In particular, in case of high correlation the differences between the results with 



n 


50 


250 


1000 


50 


250 


1000 


Approach: 


p = 0.05 


p = 0.2 


Binomial 


4 


9 


21 


4 


9 


21 


Granularity adjustment 


6 


15 


50 


9 


38 


148 


Moment matching 


7 


16 


47 


10 


33 


118 



Table 2: 99.9%-critical values for PD tests of hypothesis p < 0.01. 



the granularity approach and the moment matching approach respectively cannot be 

1 Upon request, an MSExcel-sheet with implementations of the algorithms can be obtained from the 
author. 
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any longer neglected. Since the granularity adjustment is based on an approximation 
procedure in the tail of the loss distribution, whereas the moment matching comes from 
an approximation in the center of the distribution, the granularity adjustment results will 
in general be the more reliable. But this observation should not be seen as a knock-out 
criterion against the moment matching since the use of high correlations like 0.2 might 
be considered being too conservative. 
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